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VALIDATION OF AN INSTRUMENT TO MEASURE POLITICAL AHITUDES education position or policy 



The Opinionnaire on Political Iri^tltutlons and Participation 
(OPIP) was designed to measure six dimensions of the overall 
construct of political attitude. Three studies were under^ 
taken to determine the validity and relisibility of the instru- 
mentf and the OPIP was found to be a valid and reliable instru^ 
ment for research and evaluations using imxlti^subject designs. 
Validation emd cross-validation studies indicated that the 
instrument was construct valid for measuring political attitudes. 
Reliability studies indicated that overall test^retest and internal 
consistency were moderately high. Studies of the reliability 
of the six subtests indicated that test-retest and internal 
consistency ranged from moderate to low. 

In a democratic republic it is logical that the educational system 
be expected not only to provide young citizens with political knowledge 
but also to foster attitudes supportive of the institutions and processes 
of democratic government. Consequently, political/citizenship education has 
been a main priority of the social studies curriculum in the U.S. since 
its inception in the public schools around the turn of the century. The 
importance of attitudinal outcomes of citizenship education in the schools 
has been underscored recently by the objectives of several federally funded 
national assessments of American youth (National Assessment of Educational 
Progress, 1973; 1978). Clearly implied by the assessments is the obliga- 
tion of the schools to promote attitudes favoring democratic principles 
and participation in political processes. Consequently, curriculum direc- 
tors, social studies teachers, and educational researchers must attend to 
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the practical concerns of effective measurement of the political /citizenship 
attitudes of students. 

In the last two decades, researchers have expended a considerable 
amount of time and money studying the political attitudes of students and 
assessing the influence of various factors. Schooling clearly is one of 
the factors which contributes to the shaping of political attitudes (Adelson 
and O'Neil , 1966; Hess and Torney, 1967; Levenson, 1972; Weissburg, 1972; 
Torney, Oppenheim, and Farnen, 1975), but efforts to determine the extent 
and means of the school's influence have produced inconsistent results 
(Langton and Jennings, 1968; White, 1968; Jennings and Niemi, 1968; Ehman, 
1969; Langton and Karns, 1969; Lyons, 1970; Rodgers, 1973; Woelfel, 1978). 
A considerable source of this inconsistency appears to ba the instrumenta- 
tion. The measures have been a mixed batch. The range and variety of their 
content have been nearly as great as the number of studies conducted. Most 
have been ad hoc measures prepared for a specific study and conceptualizing 
attitudes narrowly. Few of the instruments were designed or evaluated for 
purposes of establishing norms for future comparative studies or longitudinal 
research. It is the exception for a political attitude instrument to be 
reported adequately providing information about validity and reliability 
(sae Torney, et, al., 1975, Chapters 7 and 8). Seldom has a political 
attitude instrument been evaluated for its potential for collecting empirical 
data of the breath and depth necessary for theory building. 

The great majority of the political attitude instruments used with 
students havG been two to seven -item Likert type measures which attempted 
to operational ize such constructs as political efficacy, political cynicism, 
citizen's duty, political interests, and tolerance for political dissent. 
Most were based on test items used with voting age adults in national election 
survey research. A good example of the problem of quality and consistency 
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efficacy, (i.e. the feeling that the individual has some political influence) 
is probably the most extensively measured political attitude. Developed 
as a five-item scale by Campbell, Gurin, and Miller (1954) for use with 
national surveys of adults, the Political Efficacy Scale was adapted in 
multiple variations of content and length for studies with students through- 
out the sixties and seventies. Results of these studies formed many of 
the existing assumptions about the poHttcal attitudes of students, and it 
was not until the mid-seventtes that the short, quickly-constructed, often 
unpiloted instruments were criticized for low reliability, lack of construct 
validity or uni dimensionality, and failure to test political efficacy as 
it relates to students (see Stentz and Lambert, 1977 for a thorough critical 
review of the use of the Political Efficacy Scale with students). 

On the other hand, a few political socialization researchers v/ere 
attempting to develop more effective instruments for measuring student 
political attitudes. Notable is the work of Torney, Oppenheim, and Farnen 
(1975) which provided several carefully constructed attitude insturments and 
valuable analyses on which this study has drawn. However, the items in their 
their series of attitude tests were limited to cross-national commonalities 
in educational objectives. Those limitations and the need for a single instru- 
ment to be used in the time confines of one school class period prompted 
the development of a new instrument. 

The purpose of this paper is to report the development and initial 
validation of the Opinionnaire on Political Institutions and Participation 
(OPIP). The OPIP was originally intended as a measure of student outcomes 
for the Improving Citizenship Education Project, a K-12 curriculum improve- 
program in the Fulton County (Georgia) School System (see Hepburn, 1979). 
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Validation studies, however, were conducted in order to determine the 
appropriateness of the instrument for general use in measuring student 
political attitudes, and thus the studies contributed an additional measure 
of the dependent construct "political attitude" for use by researchers 
and evaluators. 

Development of the Measurement Instrument 
The Opinionnatre on Political Institutions and Participation (OPIP) 
is a 48-item instrument with six subtests each containing eight items. 
The OPIP is a multi -dimensional instrument covering a broad range of 
attitudes about political institutions and participation (Table 1). 

The first and second subtests cover attitudes toward two dimensions 
of political institutions. Subtest 1, termed Others and Political Institu- 
tions, measures the respondent's perception of how people generally should 
view American political institutions. Subtest 2, termed Self and Political 
Institutions, measures the respondent's attitude toward American political 
institutions. 

The third and fourth subtests cover two dimensions of participation 
in the public political process. Subtest 3, termed Others Participation 
in the Political Process, measures the respondent's perc iiption of how 
people in general should participate in the public political process. 
Subtest 4, termed Self Participation in the Political Process, measures 
the respondent's attitude toward personal participation in the American 
political process. 

The fifth and sixth subtests cover two dimensions of participation 
in the school political process. Subtest 5, termed Others Participation 
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in School Political Process, measures the respondent's perception of how 
others should participate in the political activities of the school. Subtest 6, 
termed Self Participation in School Political Process, measures the respon- 
dent's attitude toward personal participation in the school political 
process. 

Development of a multi-dimensional instrument was suggested by the 
findings and discussions of prior research. First, an instrument that 
includes items on political institutions as well as political participation 
was suggested by the National Assessment of Educational Progress Studies 
(1973; 1978) and Torney et. al , 0975). Second, the construct "political 
participation" was broadened beyond participation in the public political 
process to include school political participation based on the ideas of 
Entv^nstle (1971) and the research of Ehman and Gillespie (1974). Finally, 
the I/Other dichotomy in the political attitudes of students was included 
the OPIP because a number of studies (Hess and Torney, 1967; Levenson, 
1972; Wittes, 1972; Torney et. al., 1975) indicated the likelihood of 
differences between attitudes toward general participation and attitudes 

towards personal attitudes. 

Eight political concept areas guided the development of items in the 
first and second subtest on political institutions. The eight concept areas 
were governmental power, law making, electoral politics, civil liberties, 
political ethics representation, political efficacy, and global politics. 
Four concept areas related to political processes guided the development 
of the third and fourth subtests on general political participation. These 
concept areas were: electoral politics, civil liberties, justice, and 
citizen action. The fifth and sixth subtests were based on four concept 
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Table 1 

Items on Opinionnaire on Political Institutions and Participation 



SubCMC I: Others and PolicicAl lojcicucions 

(ICMi I) : P«opl« should hAvm a sat abouc whac gov«ms»nc doss. 

(?sopLs should hAv« s s«y sbouc whsc chs govertmane doss.) 

(ICM 26) : Ths gov«rTm«nc should hsy^ chs rlshc co concrol all chs sf fairs of 
ICS eitlziitu. 

(Ths Prssid«nc should havs chs rlshc co concrol all cha bahavlor 
of chs psopla.) 

(Icsoi 3) : Cosproodslng should noc bs a pare of chs law making pr.csss. 

(Law-msksrs should noc agrss Co do sonsching for ochsr taw-coaksrs 
in ordsr co gsc laws passsd.) 

(Icsffl 28): Ths Prssidsnc of chs Unicsd Scacss should havs chs righc co scop radio, 
cslsvision and nsvspapsrs from cricicizing him. 
(Ths Prssidsnc should havs chs righc co scop chs radio, cslsvision, and 
nsirspspcsrs from saying bad chings abouc him.) 

(team 5) : Govsmasnc Officisls should twc Inform chs public abouc chs misconducc 
of fsllov officials. 
(Psopls in Congrsss should noc csll chs psopls whsn chs Prssidsnc is 
bad.) 

(Icsa 30): Policies and govsmmsnc should bs complicscsd snough co kssp psopls 
from undsrscanding whac's gol^ on* 
(Govsmasnc should bs so hsrd co un^srscand chac psopls will noc knov 
whac is going on.) 

(Icsa 7) : Farcy oasabsrship should bs chs mosc la^ortanc considsracion in dsciding 
for whom co vocs. 
(Psopls who ars Dsmoerats should always vocs for Dsmocracs.) 

(team 32): Ths U.S. should givs sconomic hslp co chs poorsr councriss of chs world 
svsn if chsy can'c rsPar. 
(Ths Unicsd Scacss should givs hslp co poor councriss svsn if chs poor 
councriss cannoc rscum chs favor.) 

Subcase 2: Sslf and Political Inscicucions 

(team 15): X would go co a councy/cicy council msscing abouc rszoning land uss. 
(I would go CO a msscing abouc hov chs land is ussd.) 

(team 2) : If I wsrs chs Prssidsnc, X would wane co concrol avsryching psopls ars 
doing. 

(If I vars chs Prssidsnc, I would wane co concrol svsryching psopls are 

doing.) 

(team 27) : If I wsrs involvsd in making a nsv lair, I would agrss co do somsching 
for anochsr psrson in ordsr co gsc chs law passsd. 
(If I wsrs involvsd in making a nsw law. I' would agrss co do somsching 
for anochsr psrson in ordsr co gsc chs law passsd.) 

(Icsffl 4): If I w<^rs a govsmasnc official. I would noc cry co concrol whac chs 
radio, cslsvision, or nswspapsxS say abouc ms. 
(If I wsrs chs Prssidsnc. I would noc cry co concrol whac chs radio, 
cslsvision, or nswspapsrs say abouc ms.) 

(Icaffl 29) : If I wsrs a govsmasnc official. I would noc csll on a fallow official 
who mighc bs doing somsching wrong. 
(If I wsrs chs Govsmor. I would noc csll on psopls in Congrsss who 
mighc bs doing somsching bad.) 

(Icsm 6): If I wsrs a policician. I would noc wane psopls Co know whac's going o 
on. 

(If I wsrs chs Mayor of Aclanca, I would noc wane psopls co know whac 
was going on in 07 coimmmiey.) 

(Icsm 31): I would vocs for a frisnd no maccsr whac my friend fslc abouc chs 
Issuss. 

(I would vocs for a frisnd no maccsr whac my frisnd fslc abouc whac 
chs govsmasnc should do.) 

(Icsa 3): I would noc givs away any mors of our wsalch co hslp forsign councriss. 

(I would noc givs away any mors of our monsy co hslp ochsr councriss.) 

8 
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SubCtttt 3: OthftTS P«rricip«cloa in Policlcml Process 

(ICM 9) : SoM p«opU should noc b« «llov«d co voc« in sUccions b«c«us« ch«s« 
p«opl« ar« Qoe smart snoi^. 
(Son* ottoplA should aoc b« «Llov«d co voc« in •Isccions b«c«us« ch«s« 
p«opI« «r« no? snare snough.) 

(team 33): A maa caopaimlng on caJavlsion for candldacas of cha Aaarlcan Nazi 
Parry ihould hava cha rlghc co do so. 
(A parson should ba abla co spaak for soaa Idaa no naccar whac cha 
Idaa Is.) 

(Icaa IT): ScM paopla should ba givan spacial craacnanc by govammanc bacauaa 
chay hava mora nonay. 
(SoM paopla should ba givan spacial craacaant by cha Prasidanc bacauaa 
chay hava taora aonay.) 

(Icaa 41) : Paopla who ara arrjscad for a crioa should hava co prova chafflsalvas 

Inaocanc. 

(Paopla who ara arras cad for a crima should hava co prova chac chay 

did noc do ic.) 

(Icaa 11) : Paopla should voca avan whan chay chink chair policical party doasn'c 
hava a chaaca co win. 
(Paopla shotild voca avan whan chay chink chair choica for Prasidanc 
doas noc ha%a a chanca co win.) 

(Icarn 35): Paoplo shotild noc criciciza cha raprasancacivas , Ic only Incarrupcs 
cha rapraaancacivQs' work. 
(Paopla should noc calk badly abouc Lav-cakars, ic only hurts cha 
Law-makars' work.) 

(Icam 19) : Evary parson should giva soma of his/bar cima for cha good of cha 
coxanunicy . 

(Evary parson should giva soma of his/har ciaa for cha good of cha 
eonnunity. ) 

(Icaa 43): Paopla should ba willing co sarva on juriaa. 

(Paopla should ba willing co sarva on a Jury co dacida if a parson 
broka cha lav.) 

Subcase 4: Salf Parcicipacion in Policical Procass 

(Icaa 24) : If I had cha policical povar, I would noc lac anyona spaak badly abouc 
cha U.S. govarnmanc. 
(If I wara cha Prasidanc. I would noc lac anyona spaak badly abouc cha 
Unicad Scacas govammanc.) 

(Icaa 43) : If I could, I would scop paopla froa campaigning for changas in 

fovammanc chac I did noc lika. 
I could, I would scop paopla froa asking ochars co voca for changas 
in our govammanc chac I did not lika.) 

(Icaa 10) : If I wara rich. I would wane tha govammanc co giva mm s'pacial 
craacaanc. 

(If I wara rich* I would wane cha Govamor co giva ma spacial 
craacaanc . ) 



(Icaa 34) : If I wara arraacad by cha polica. I would wane co ba conaidarad 
innocanc tmtil provan guilty. 
(If I wara arrascad by cha polica, I would wane cha polica co considar 
chac I did not braak a law uneil chay prova I did.) 

(Icaa 18): I would noc voca in an alaccion unlass I choughc cha candidaca I likad 

would win. 

(I would noc voca in an alaccion unlass I choughc cha parson I likad 

would win.) 

(Icaa 42): If I wara a congrassional raprasancaciva , I would lika cricicisa'of ov 
work from paopla. 

(If I wara cha Prasidanc, I would lika cha paopla co call oa how I was 

doing. } 

(Icaa 12): I would noc work in a policical campaign, ic is coo cima consuaing. 

(I -could nc-c work co halp a parson I lika co bacoaa Prasidanc, ic cakas 
up coo aiuch cima.) 

(Icaa 36) : If I wara callad for Jury duty, I would not lika to wasta my tima 
r-ni/^" sarving. 

tRlL ^ wkad to dacida if a parson broka tha law, I would not lika 

aiMfeij^ to waata oqr tiaa doing it.) 

n 
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SubCttsc 5: Ochttrs PAZxicipACion In School PoIIcIcaL Procttss 

(Ic«a 13): SeudMCf should aoc hAVt any lnflu«nc« In making school rulta. 

(Seud«ncs should aoc havt any part in making school rulaa.) 

(Icaa 37): Scudanta should ba InvQlvad In school dacision-oaklng procaaaaa. 
(Seuxianca should ba Involvad In making school daciaiona.) 

(lean 21): A smd«nc council should hava soma auchoricy in making rulaa abouc 
scudanc bahavlor. 

(A acudanc council should hava aoaa sya so in making rulaa about hov 
paopla bahav* in achool.) 

(team 45): ScudanCa should Join cluba, school scudanc coundla, and ochar school 
scudrac organixaciona.) 
(Studaena should Join school cluba and scudanc councila.) 

(Icao 15): Seudancj should ba conaidarad gullcy by a school principal uncil provan 
Isnocanc. 

(Studanca should ba conaidarad co hava brokan a school rula uncil 
seudanca show chay hava noc dona ic.) 

(Icao 39): Studanca should not ba punlahad for braaking school rulaa. 

(Studancs should not ba punishad for breaking school rulaa.) 

(Icaa 23): Studanca shouldn't ba allovad to apaak out againat a school rula. 

(Studanta shotild not ba alXovad to spaak out againat a school rula.) 

(Itaa 47) : Studanta should hava cha opportunity to publish thair own navapapar. 
(Seudanta shotild hava cha chanca to vrita thair own navapapar.) 

Subtaat 6: Salf Participation In School Political Procaaa 

(Itam 20) : I would lika to ba mora Involvad in making rulaa about studant bahavlor 

in school. 

(I would lika to ba mora involvad In making rulaa for hov paopla 
bahava in school.) 

(Itam 44) : I would anjoy balng Involvad In making school daciaiona. 

(I would anJoy baing Involvad In making school daciaiona.) 

(Itam 14) : If I got togathar wlch soma othar studants lika ma, wa would hava a lot 
of Influanca on what rulaa vara mada for cha school. 
(If I got togachar with soma ochar studants lika ma, wa would hava a 
lot of say so on what rulaa wara mada for our school.) 

(Itam 38) : I would not Join a school club or studant council. 

(I would not Join 5 school club or studant council) . 

(Itam 22) : If I wara a school principal. I would conaidar a studant Innocant until 
provan guilty. 

(If I wara a school principal. I would baliava a studant did not braak 
a rula until It la provan that tha studant did tha crlma.) 

(Itaa 46) : If a frland broka a school rula. I would try to halp that studant gat 
away wlch it. 

(If a frland broka a school rula» I would try to halp that studant gat 
away with It.) 

(Itam 16) : If I dlsagraa wlch a school nila, I would not ba allowad to spaak out 
againat It. 

(If I dlsagraa with a school ra^i, I would not ba abla to spaak out 
againat It.) 

(Itaa 40) : It would ba a waatc of m^ tlma to try to gat a rula changad in my 

school. 

(It would ba a waata of cay tlma to try to gat a rula changad In my 

school. ) 



NOTE: Statamanta In paranthaaaa ara cha statamants found on tha alamantary 

form. 
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was scored 1 (negative), 2 (neutral) or 3 (positive). The score values 
assigned to each statement were based on the judgment of the developers, 
review by political educators, and the results of a pilot study of the 
instrument conducted prior to the first validity study. 

Validation Procedures 

The construct validity of the OPIP was examined in two studies— a 
validation study and a cross-validation study. In addition the internal 
consistency of the instrument was also studied in these validation studies. 
A third study examined the test-retest reliability of the instrument. 

The construct validity studies involved examination of the theoretical 
operations of the instrument. It was hypothesized that the OPIP would: 

1. produce one factor among the subtests; 

2. produce subtests with, unique factors; 

3. produce differences in attitude between grade levels; 

4. produce differences in attitude between subtests; 

5. produce moderate correlation with knowledge of political institutions 
and participation. 

The reliability studies involved examining the overall test-retest 
correlations of the OPIP, and the test-retest correlations of the subtests. 
In addition, internal consistencies of tKe overall instrument and the 
subtests were examined using the Spearman -Brown Prophecy formula for split- 
half correlations. 

Subjects 

Subjects for all three studies were drawn from a large metropolitan 
school system in the southeast. This school system contained a student 
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population with a variety of socio-economic statuses. The student popula- 
tion was about 50 percent male and 50 percent female. The racial break- 
down was about 75 percent white and 25 percent black. 

In the two validity studies, classes were randomly selected from the 
third grade, eighth grade, and twelfth grade in schools selected as 
representative of the district's socio-economic distribution. These 
grade levels were selected because they represented the typical top grade 
level for primary, middle, and secondary grades. For the reliability study, 
students were from classes of teachers who volunteered to give the two adminis- 
trations of the test instrument. These latter classes were from various 
primary, middle, and secondary grades of the same schools used In the validity 
studies. 

In the first construct validity study, 515 subjects were used. There 
were 133 third graders, 169 eighth graders, and 213 twelfth graders. Overall, 
48 percent were males and 52 percent were females. Also, 90 percent were 
white and 10 percent were black. 

In the second construct validity study, 920 subjects were used. There 
were 321 third graders, 319 eighth graders, and 280 twelfth graders. 
Overall, 51 percent were males and 49 percent were females. Also, 78 
percent were white and 22 percent were black. 

In the test-retest reliability study, 1080 students were tested. These 
students Included 10% of those in the second validity study. There were 
360 primary grade students, 304 middle school students, and 416 secondary 
students. Overall, 50 percent were males and 50 percent were female. Also, 
78 percent were white and 22 percent black. 

1 o 
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Data Conection 

The OPIP was administered to the 515 students in the first validity 
study in March of the school year. The knowledge measure used in the vali- 
dity study was administered one day prior to the OPIP. The knowledge measure 
used was the Citizenship Knowledge Test which has both a secondary fom 
and an elementary fonn. The validity and reliability data for both forms 
of the Citizenship Knowledge Test were reported elsewhere (Hepburn and 
Strickland, 1979). 

The OPIP was administered to the 920 students in the second validity 
study a year later in March. The Citizenship Knowledge Test was again 
used, and it was given the day prior to the OPIP. 

In both validity studies, the measurement instruments were administered 
through the school system by classroom teachers. In the primary grade 
classes, teachers read the measurement instruments to their students. Be- 
cause it was not administratively possible to obtain makeup test data from 
absent students, students who took the OPIP but did not take the" knowledge 
test were treated as missing data in the correlation of the OPIP scores with 
knowledge scores. 

For the test-retest reliability study the OPIP was administered to the 
1080 subjects in March of the same school year as the second validity study 
and again 10 weeks later in May. Only those students present at both 
administrations of the OPIP (1080) were used in the study because 'it was 
administratively impossible to collect data on absent students. 

Results 

Validity Studies 

Factor analysis results . The first step in analyzing the data from 
the two validity studies was to determine 1) 1f there was one factor common 
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to the six subtests, and i) if there were unique factors associated with 
the six subtests. To find answers to these questions, factor analysis 
was used. The factor analysis procedure employed was Principle Factoring with 
Iteration using Oblique rotation (Nie, Hull, Jenkins, Steinbrenner and 
Bent, 1975). The results of the factor analysis of the data from the 
first and second validity studies is presented in Table 2. These results 
Indicated that there was only one factor common to the six subtests in 
both validity studies so no rotations were required. The one factor. 
Political Attitude, accounted for 48 percent of the variance in the first 
validity study and 40 percent of the variance in the second validity study. 
The remaining variance was made up of the unique factors related to the 
individual subtests. 

Analysis of variance results . The second step in analyzing the data 
from the two validity studies involved examining these questions: 1) Were 
there differences between grade levels on overall OPIP scores? and 2) Were 
there differences between subtest scores on the OPIP? These two questions 
were studied using analysis of variance for repeated measures procedures 
on the mean scores presented in Table 3. The analysis of variance test 
results on the data from the two validity studies is given in Table 4. 
The analysis of variance test results demonstrate that there was a signifi- 
cant (p<.05) difference between Grade Level means and a significant 
difference between overall Subtest means (Table 4). 

Because the analysis of variance test only indicated differences between 
the highest and lowest mean, Newmann-Keuls' Sequential Range Test procedures 
were used to test all pairs (Bruning and Kintz, 1978). It was noted that 
the difference between Grade Level means was applicable to all pairs of 




Table 2 

Factor Analysis Results for Two Validity Studies 





First Validity Study 


Second Validity Study 


Subtest 


Factor 


Commonality 


Factor 

« 


Commonality 


!• Others & Political Institutions 


.74 


.55 


.62 


.39 


2. Self & Political Institutions 


.65 


.42 


.54 


.29 


3, Others Participation in 
Political Process 


.66 


.44 


.62 


.39 


4. Self Participation in Political 
Process 


.79 


.62 


.77 


.59 


3, Utners rarLicipaLion in ocnooi 
Political Process 


.76 


.58 


.68 


.46 


6. Self Participation in School 
Political Process 


.52 


.27 


.53 


.28 




Eigenvalue 


2.88 (48%) 


Eigenvalue 


2.40 (40% 



i >' 



Table 3 

Means and Standard Deviations for First and Second Validity Studies 









First Validity Study 


Second Validity Study 








3rd 


8th 


12th 




3rd 


8th 


Uth 




Subtest 




grade 


grade 


grade 


Combined 


grade 


grade 


grade 


Combined 


1 . 


Others & Political 


Mean 


17.6 


19.6 


21 .2 


19.5 


1. .9 


19.8 


21.1 


19.6 




Institutions 


S.D. 


2.6 


2.6 


2.1 


2.8 


2.4 


2.6 


2.1 


2.7 


2. 


Self & Political 


Mean 


17.4 


19.1 


19.8 


18.8 


18.6 


19.5 


20.0 


19.3 




Institutions 


c n 


2.5 


2.3 


2.2 


2.5 


2.8 


2.3 


2.3 


2.6 


3. 


Others Participa- 


Mean 


17.9 


20.1 


21.1 


19.7 


18.5 


19.9 


20.7 


19.7 




tion in Political 


c n 


2.3 


1 .9 


2.0 


2.4 


2.2 


2.1 


2.2 


2.3 




Process 




















4. 


Self Participation 


Mean 


17.7 


20.3 


21.4 


19.8 


18.6 


20.1 


21.0 


19.9 




in Political 


c n 
o • U . 


2.9 


2.3 


2.3 


2.8 


2.4 


2.4 


2.3 


2.6 




Process 




















5. 


Others Participa- 




17.8 


21 .5 


22.6 


20.6 


18.2 


21.4 


22.7 


20.7 




tion in School 


S.D. 


2.8 


2.5 


1.8 


3.0 


2.9 


2.6 


1.8 


3.1 




Political Process 




















6. 


Self Participation 


Mean 


18.5 


20.2 


20.2 


19.6 


18.8 


19.7 


20.4 


19.7 




in School Politi- 


S.D. 


2.5 


2.6 


2.5 


2.7 


2.6 


2.6 


2.4 


2.6 




cal Process 






















OVERALL 


Mean 


106.9 


120.8 


126.3 


118.0 


110.6 


120.4 


125.9 


118.9 






S.D. 


10.1 


9.7 


8.8 


12.3 


9.2 


9.9 


8.7 


11.2 
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comparisons in both validity studies. That is, third graders scored lower 
than eighth graders and twelfth graders, and eighth graders scored lower 
than twelfth graders. 

When comparing means for all pairs of combined Subtest scores in the 
first validity study (Table 3) the subtest Self and Political Institu- 
tions was significantly lower than all other subtest means, and the sub- 
test Others Participation in School Political Process was significantly 
higher than all the other subtest means. All other mean comparisons in 
the first validity study were not significant. Again, comparing means 
for all pairs of combined subtest scores in the second validity study, the 
subtest Others Participation in School Political Process was significantly 
higher than any other subtest mean (Table 3). However, subtest Self and 
Political Institutions was significantly lower than only two other sub- 
test means, Self Participation in School Political Process and Self Partici- 
pation in Political Process. All other mean comparisons in the second 
validity study were not significant. 

The significant interaction between Grade Levels and Subtests (Table 
4) indicated that the overall findings for combined scores did not generalize 
to the differences between Grade Levels for each Subtest and/or between 
Subtests at each Grade Levels. Therefore, further post hoc analyses were 
conducted using the Newmann-Keuls Sequential Range Test procedures. 

The overall significant differences between Grade Levels were confirmed 
for each subtest in the first validity study except for differences between 
eighth and twelfth graders on the subtest Others Participation in School 
Political Process (Table 3). For the second validity study, there were 
differences between the three grade levels on all subtests (Table 3). 

ERIC 



Table 4 

Analysis of Variance for Repeated Measures on Scores From First and Second Validity Studies 







First Validity Study 


Second Validity Study 


Sou rce 


d.f . 


M.S. 


F 


d.f. 


M.S. 


F 


Grade Levels 


2 


2794.88 


187.70* 


2 


3132.99 


217 .26* 


Subjects w/groups 


512 


14.89 




917 


14.42 




Subtests 


5 


173.19 


45.56* 


5 


211.54 


51.22* 


Grade Level 
X Subtests 


10 


57.99 


15.59* 


10 


110.69 


26.80* 


Subtest X subj . 
w/groups 


2560 


3.72 




4585 


4.13 




TOTAL 


3089 


7.6b 




5519 


7.35 





*Significant at the £ < .001 level 
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in the third grade scores for the first validity study, the subtest 
Self Participation in School Political Process was significantly higher 
than all other subtests. For the third grade scores for the second validity 
study, subtests Others Participation in Political Process and Others Parti- 
cipation in School Political Process were significantly lower than the other 
subtests. But, there were no other differences between subtests in either 
validity study. 

In the eighth grade scores for the first validity study, subtest 
Others Participation in School Political Process was significantly higher 
than the other subtests. Also, the subtests Self and Political Institu- 
tions, and Others and Political Institutions were significantly lower than 
the other subtests. In the eighth grade scores for the second validity 
study, subtest Others Participation in School Political Process was signi- 
ficantly higher than the other subtests. In addition ,' Self and Political Institu- 
tions was significantly lower than Others and Political Institutions. 
However, there were no other significant differences. 

For the twelfth grade scores for the first and second validity studies. 
Others Participation in School Political Process was significantly higher 
than the other subtests. Also, Self and Political Institutions was signi- 
ficantly lower than the other subtests. For the twelfth grade scores in 
the first validity study. Self Participation in Political Process subtest 
was also significantly lower than other subtests. For the twelfth grade 
scores in the second validity study Self Participation in School Political 
Process was significantly lower than the other subtests, and Others Parti- 
cipation in Political Process was significantly lower than Others and 
Political Institutions. 
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The differences between Grade Levels on Subtests observed in both 
validity studies appear logical. The progression from an almost neutral 
attitude on all subtests at third grade to higher attitude means in eighth 
and twelfth grades is consistent with the idea that with increased cognitive 
development there is increased intensity of political attitudes and ideological 
cofTiTiitment (Adelson and O'Neil, 1966). 

The differences between Subtests within Grade Levels is also logical. 
The fact that the third grade results indicate that these subjects rated 
subtests related to self higher is consistent with the idea that students 
at that young age do not form clear attitudes about more abstract political 
concepts. Rather, they respond to more concrete political concepts 
especially those within the realm of their personal experience. 



The higher scores for both eighth and twelfth grades on the Others 
Participation in School Political Process subtest indicate that students 
at these grade levels felt that students generally should be active parti- 
cipants in the school decision-making process. This bears out similar 
findings by Ehman and Gillespie (1974) and the National Assessment of 
Educational Progress (1973). The low attitude scores of the eighth 
and twelfth graders on the Self and Political Institutions and Self and 
School subtests suggests, that students felt that actually they did not have 
much influence in their schools or on other political institutions. 

Overall, the results of the analysis of variance test and post hoc 
analysis tend to support the construct validity of the OPIP. First, the 
OPIP differentiates between different age groups. Second, the subtests 
of the OPIP differentiate between attitudes about different political 
institutions and participation in a logical manner. 
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Correlation Results . The third step in analyzing the data from the 
two validity studies involved correlation of overall OPIP scores with 
overall scores from the Citizenship Knowledge Test, For the first validity 
study* third grade scores correlated .54 (N=133); eighth grade scores 
correlated .51 (N=155); and twelfth grade scores correlated .45 (N=197). 
For the second validity study, third grade scores correlated .43 (N=309); 
eighth grade scores correlated .47 CN*299]; and twelfth grade scores 
correlated .52 CN=246). Thus, the correlations were all significant but 
moderata. Knowledgeof political institutions and participation was posi- 
tively related to scores on the OPIP but did not account for more than 29 
percent of the variance of any grade level scores on the OPIP. 

Reliability Studies 

Internal consistency results . The results of the split-half correla- 
tions corrected by the Spearman-Brown Prophecy formula are presented in 
Table 5. The overall internal consistency reliabilities for data from 
the first and second validity studies were moderately high. However, the 
internal consistency reliabilities from data from the subtests in both 
validity studies were low to moderate. These findings are consistent with 
the fact that the overall OPIP test has one factor, and most likely the 
subtests have the mul tidimensions (See discussion of concept areas of the 
subtests presented above). These results for all grade levels combined are 
similar to the separate internal consistencies presented in Table 5. 

Test-retest results . The results of the test-retest correlations are 
also presented in Table 5. The overall test-retest correlation is 
moderate to moderately high. The test-retest correlations for the sub- 
tests range from moderate to moderately low. Given the small number of items in each 

9 0 



Table 5 

Stability and Internal Consistency Reliability Data Overall and by Grade Level 



Internal Consistency 

Test-Retest First Validity Study Second Validity Study 

Pri- Mid- Sec- 

mary die ondary 3rd 8th 12th 3rd 8th 12th 

Overall grade grade grade Overall grade ^rade grade Overall graue grade ^ade 



.38 .51 .46 



Test .78 .83 .73 .73 .85 .77 .81 .73 .82 .67 .78 

Subtests: 

1 . Other & Political 

Institutions .59 .57 .47 .64 .53 .36 .46 .38 .54 

2. Self & Poii::ical 

Institutions .40 .45 .31 .40 .30 .15 .27 .22 .35 

3. Others Participation 
in Political Process .57 .57 .41 .58 .44 .26 .13 .31 .36 

4. Self Participation 

in Political Process .63 .66 .59 .61 .58 .41 .48 .53 .38 

5. Others Participation in 
School Political Process .63 .64 .59 .48 .67 .50 .49 .24 .66 

6. Self Participation in 
School Political Process .56 .57 .54 .58 .46 .39 .43 .48 .40 



.81 



.41 
.30 
.31 
.44 



,26 
.17 
.41 
.52 



.37 



.35 



.51 



.44 



I 



.37 .36 .37 



?3 



Of 
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subtest these correlations were not unexpected. The test-retest correla- 
tions for an grade levels combined are also generally similar to the 
separate test-retest correlations presented in Table 5. 

Conclusions 

The results of the two validity studies indicate that the OPIP pro- 
duced the five theoretical operations hypothesized: one factor among 
subtests, subtests with unique factors, differences in attitude between 
grade levels, differences in attitude between subtests, and moderate 
correlation with knowledge of political institutions and participation. 
Hence, the OPIP has construct validity. 

Given the results of this validation study, experimental studies now 
seem warranted to determine if the OPIP is sensitive to changes in atti- 
tudes after exposure to experimental treatments. These experimental stu- 
dies would be additional sources of evidence of construct validity. 

It must be noted that the data in this present study indicate such 
experimental treatments must be long term and must not rely solely on 
content knowledge to change attitudes. It was observed that the mean 
differences between third and twelfth grade students ranged from 10 (first 
validity study) to 15 (second validity study) points. Thus it appears that 
short-term treatments are unlikely to cause significant change. Also, 
the observation that knowledge accounted for less than 29 percent of the 
variance of attitude scores implies that treatment must include more than 
mere exposure to information about political institutions and political 
participation. 
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The overall reliablity coefficients indicate that the OPIP produces 
stable data about subject performance. But, the use of rhe OPIP subtests 
should be limited to comparisons between groups because of the moderate to 
moderately low reliability coefficients. 

In suimiary, the results of the validation study indicate that although 
the Opinionnaire on Political Institutions and Participation is not 
appropriate for diagnosing attitudes of individuals, it is an effective 
and appropriate instrument for measuring political attitudes in research 
or evaluation using multi -subject designs. 
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